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(57) Abstract 



An intelligent agent (42) and its client (10) communicate using a selector known by both parties to generate and interpret messages 
and thereby effectively disguise confidential information transmitted in the messages from third parties. Moreover, a neural network is used 
to implement the decision logic and/or the message disguising functions of an agent (42) such that the logic employed in such functions is 
not readily reverse compiled or scanned by third parties. 
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Description 

Apparatus and Method for Communicating 
Between an Intelligent Agent and Client Computer 
Process Using Disguised Messages 

5 Cross-reference to Related Applications 

This application is related to the following U.S. 
Patent Applications, all of which were filed on even date 
herewith by Bigus et al: U.S. Serial No. 08/821,935 entitled 
"INTELLIGENT AGENT WITH NEGOTIATION CAPABILITY AND METHOD OF 

10 NEGOTIATION THEREWITH", U.S. Serial NO. 08/826,107 entitled 
"APPARATUS AND METHOD FOR OPTIMIZING THE PERFORMANCE OF 
COMPUTER TASKS USING MULTIPLE INTELLIGENT AGENTS HAVING VARIED 
DEGREES OF DOMAIN KNOWLEDGE" and U.S. Serial No. 08/822,99 3 
entitled "APPARATUS AND METHOD FOR OPTIMIZING THE PERFORMANCE 

15 OF COMPUTER TASKS USING INTELLIGENT AGENT WITH MULTIPLE PROGRAM 

MODULES HAVING VARIED DEGREES OF DOMAIN KNOWLEDGE" . The 
disclosures of all of these applications are hereby 
incorporated by reference herein. 

Field of the Invention 

20 The invention is generally related to intelligent 

agent computer programs executable on computer systems and the 
like, and in particular, the decision logic and communications 
mechanisms used by such programs. 

Background of the Invention 

25 Since the advent of the first electronic computers 

in the 1940 's, computers have continued to handle a greater 
variety of increasingly complex tasks. Advances in 

semiconductors and other hardware components have evolved to 
the point that current low- end desktop computers can now handle 

30 tasks that once N requi red roomfuls of computers. 

Computer programs, which are essentially the sets of 
instructions that control the operation of a computer to 
perform tasks, have also grown increasingly complex and 



-1- 



WO 98/47250 



PC17US98/04876 



powerful. While early computer programs were limited to 
performing only basic mathematical calculations, current 
computer programs handle complex tasks such as voice and image 
recognition, predictive analysis and forecasting, multimedia 
5 presentation, and other tasks that are too numerous to mention. 

However, one common characteristic of many computer 
programs is that the programs are typically limited to 
performing tasks in response to specific commands issued by an 
operator or user. A user therefore must often know the 
10 specific controls, commands, etc. required to perform specific 
tasks . As computer programs become more complex and feature 
rich, users are called upon to learn and understand more and 
more about the programs to take advantage of the improved 
f unc t i ona 1 i ty . 

15 In addition to being more powerful, computers have 

also become more interconnected through private networks such 
as local area networks and wide area networks, and through 
public networks such as the Internet. This enables computers 
and their users to interact and share information with one 

20 another on a global scale. However, the amount of information 
is increasing at an exponential rate, which makes it 
increasingly difficult for users to find specific information. 

As a result of the dramatic increases in the both 
complexity of computer programs and the amount of information 

25 available to users, substantial interest has developed in the 
area of intelligent agent computer programs, also referred to 
as intelligent agents or simply agents, that operate much like 
software -implemented fc>assis tantsfc) to automate and simplify 
certain tasks in a way that hides their complexity from the 

30 user. With agents, a user may be able to perform tasks without 
having to know specific sequences of commands. Similarly, a 
user may be able to obtain information without having to know 
exactly how or where to search for the information. 

Intelligent agents are characterized by the concept 

35 of delegation, where a user, or client, entrusts the agents to 
handle tasks with at least a certain degree of autonomy. 
Intelligent agents operate with varying degrees of constraints 
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depending upon the amount of autonomy that is delegated to them 
by the user. 

Intelligent agents may also have differing 
capabilities in terms of intelligence, mobility, agency, and 
5 user interface. Intelligence is generally the amount of 
reasoning and decision making that an agent possesses. This 
intelligence can be as simple as following a predefined set of 
rules, or as complex as learning and adapting based upon a 
user's objectives and the agent's available resources. 

10 Mobility is the ability to be passed through a 

network and execute on different computer systems. That is, 
some agents may be designed to stay on one computer system and 
may never be passed to different machines, while other agents 
may be mobile in the sense that they are designed to be passed 

15 from computer to computer while performing tasks at different 
stops along the way. User interface defines how an agent 
interacts with a user, if at all. 

Agents have a number of uses in a wide variety of 
applications, including systems and network management, mobile 

20 access and management, information access and management, 
collaboration, messaging, workflow and administrative 
management, and adaptive user interfaces. Another important 
use for agents is in electronic commerce, where an agent may 
be configured to seek out other parties such as other users, 

25 computer systems and agents, conduct negotiations on behalf of 
their client, and enter into commercial transactions. 

Just as human agents have a certain amount of 
autonomy, intelligent agents similarly have a set of 
constraints on what they are authorized and not authorized to 

30 do. For example, a selling agent for electronic commerce 
. applications may be constrained by a minimum acceptable price. 
However, a good selling agent, whether electronic or human, 
would never initially give its lowest acceptable price, as this 
would minimize profit margins. Furthermore, giving the lowest 

35 price may not even assure sales because a buyer may infer that 
the price is not competitive because the agent is unwilling to 
lower the price from the original offer. Therefore, an agent 
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typically starts negotiations with some margin from its worst 
case acceptable price, then works toward a mutually acceptable 
price with the other party. 

Any negotiation plans, techniques, strategies or 
5 other confidential information used by an intelligent agent to 
operate within its constraints, however, often should be hidden 
from other parties. Otherwise, the agent is placed at a 
competitive disadvantage. Given that many agents may be 
dispatched to unsecured environments, an assumption must be 

10 made that other parties may be able to scan or reverse engineer 
an agent to learn its negotiation strategy or other 
constraints. It must also be assumed that other parties may 
be able to decode messages sent between an agent arid its client 
to obtain the greatest advantage in negotiation. The validity 

15 of such assumptions stems from the fact that these techniques 
are conceptually similar to many of the techniques used by some 
salespeople to obtain the best price possible. 

For example, if a message to an agent from its client 
indicates that the agent should offer $100, but is authorized 

20 to go as low as $90, another party that intercepts this message 
immediately knows that a transaction may be completed at the 
lower price. Also, even if the message is not intercepted, if 
the agent has stored the $9 0 price as its lowest authorized 
offer, reverse compilation or scanning of the agent by another 

25 party may lead to similar results. 

Efforts have been made to encrypt messages between 
an agent and its client. However, most conventional encryption 
methods rely on private £>keysfc> for the agent and the client. 
Encryption presupposes that both the sender and receiver are 

30 in secured environments - - only the transmission path between 
them is unsecured. However, as an agent may be resident on and 
executing in an unsecured environment, the agent may be reverse 
compiled or scanned to obtain its private key and thereby break 
the encryption. Consequently, conventional encryption 

35 techniques do not adequately protect the confidential 
communications of agents or other computer • programs executing 
in unsecured environments. 
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Therefore, a significant need exists in the art for 
a manner of protecting the confidential information of an 
intelligent agent computer program. 

Summary of the Invention 
5 The invention addresses these and other problems 

associated with the prior art in providing a manner of 
communication between an agent and its client where a selector 
is used in the generation and interpretation of messages to 
effectively disguise confidential information transmitted in 
10 the messages from third parties. In contrast to encryption 
techniques which attempt to scramble the contents of a message, 
the selector controls how a given message, which" need not be 
scrambled, is interpreted by transmitting and receiving 
parties . 

15 A selector for use with the various embodiments of 

the invention may be a predetermined parameter known to both 
the agent and client, or may be transmitted between the agent 
and client in the same message as the confidential information 
or in a separate message. Moreover, the selector may be 

20 maintained as a distinct parameter that is known by or 
transmitted between the parties, or may be derived from an 
existing parameter having another use or purpose. 

The selector may be used in a number of manners to 
disguise confidential information. For example, the selector 

25 may be used to select one of a plurality of messages to 
transmit, to select one of a plurality of alternate meanings 
for a particular message, to select where the confidential 
information is in a plurality of transmitted messages, and to 
indicate which of a plurality of messages to omit from a 

30 transmission, among others. 

Moreover, in certain embodiments of the invention, 
the decision logic of an agent .may be disguised from third 
parties through the use of neural networks to implement part 
or all of the decision logic. Neural networks, which rely on 

35 interconnected nodes having variable weights to encode logic, 
are not readily reverse compiled or scanned, thus offering 
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significant security advantages for an agent that is operating 
in an unsecured environment. 

These and other advantages and features , which 
characterize the invention, are set forth in the claims annexed 
5 hereto and forming a further part hereof. However, for a 
better understanding of the invention, and of the advantages 
and objectives attained through its use, reference should be 
made to the Drawing, and to the accompanying descriptive 
matter, in which there is described illustrated embodiments of 
10 the invention. 

Brief Description of the Drawing 

FIGURE 1 is a flowchart illustrating the operation 
of an intelligent agent consistent with the principles of the 
invention, utilizing procedural decision making and message 
15 disguising. 

FIGURE 2 is a flowchart illustrating the operation 
of another intelligent agent consistent with the principles of 
the invention, utilizing neural network- implemented decision 
making and procedural message disguising. 
20 FIGURE 3 is a flowchart illustrating the operation 

of another intelligent agent consistent with the principles of 
the invention, utilizing neural network- implemented decision 
making and message disguising. 

FIGURE 4 is a block diagram of a networked computer 
25 system environment for use with the illustrated embodiments of 
the invention. 

FIGURE 5 is a block diagram of the networked computer 
system of Fig. 4, illustrating the interaction between 
intelligent agents therein. 
30 FIGURE 6 is another block diagram of the networked 

computer system of Fig. 4, illustrating in greater detail the 
primary components in the client and remote computer systems. 

FIGURE 7 is a flowchart illustrating the interaction 
between the agent manager, mobile agent and negotiating agent 
35 (other party) of Fig. 5. 



-6- 



WO 98/47250 



PCT/US98/04876 



FIGURES 8a and 8b are block diagrams illustrating the 
primary components in one embodiment of the intelligent agent 
of Fig. 5. 

FIGURE 9 is a flowchart illustrating the program flow 
of a network training routine for use in training the neural 
network in the intelligent agent of Figs. 8a and 8b. 

Detailed Description of the Illustrated Embodiments 

The embodiments of the invention incorporate various 
manners of disguising confidential information in an 
intelligent agent from third parties. 

Intelligent agents are computer programs which have 
been delegated a degree of autonomy but which are limited to 
operating within constraints defined by their client (which may 
be, for example, another agent; a computer program, application 
or system; or an individual interacting with the agent through 
a computer -- hereinafter a client computer process) . A subset 
of such agents which are capable of being passed between and 
operating in different applications or computer systems are 
referred to as mobile agents. 

In general, an agent has the ability to sense, 
recognize and act. These functions are typically embodied in 
a number of components, including an engine, a knowledge 
component, an adapters component, a library, and a view 
component. Generally, the engine controls the overall 
operation of an agent and functions as the fc>brains*> of the 
agent, and the knowledge component stores information that is 
representative of the acquired knowledge of the agent. The 
adapters component handles interaction between an agent and 
external objects, thereby functioning as the mechanism through 
which the agent fc>senses£> and interacts with its environment. 
A library persistently stores the information utilized by the 
knowledge component, and the view component provides the human 
interface, if any, for an agent, e.g., for supplying 
instructions to the agent. 

An agent may receive, transmit, store and otherwise 
utilize confidential information such as data, unique decision 
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logic or strategies, desired goals, etc. to which a client may 
wish to limit access by third parties. For example, in 
electronic commerce applications, an agent may wish to prevent 
parties with which it is negotiating from knowing certain 
5 information such as its negotiation strategy and authorized 
offer limits. This confidential information may be subject to 
scrutiny, however, if another party is capable of intercepting 
messages between the agent and its client, or if another party 
is capable of reverse compiling or otherwise scanning the 

10 program code of the agent. 

To address the former problem, the embodiments of the 
invention utilize a unique signaling methodology which relies 
on a selector that is ultimately known by both the agent and 
agent manager to generate and interpret messages which disguise 

15 the confidential information contained therein. As will become 
apparent below, in contrast to encryption techniques, the 
messages need not be modified, encrypted or scrambled, as the 
selector is used primarily to interpret the meaning of the 
messages. 

20 One difference between the use of a selector and 

encryption techniques is that, in the case of a selector, a 
third party may mistakenly believe a message has a different 
meaning than its true meaning and may inadvertently act to the 
advantage of the client. Another advantage over encryption is 

25 that the fact that a message is disguised is not readily 
apparent, whereby the message typically does not stand out 
relative to other messages. It should be appreciated, however, 
that encryption techniques may be used in combination with 
message disguising in certain embodiments of the invention, 

30 with encryption used on disguised or undisguised messages. In 
one embodiment, for example, the information to be transmitted 
may be sent in disguised messages with encrypted decoy messages 
also sent to draw attention away from the disguised messages. 

For example. Fig. 1 illustrates a program flow for 

35 an intelligent agent 160 consistent with the invention. Agent 
160 operates by receiving input at block 162 and making a 
decision based upon the input at block 164. Block 164 outputs 
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confidential information therefrom, which is disguised in a 
message in block 166 based upon a selector 167. The message 
is then sent in block 168 and control returns to block 162. 

The use of a selector may be analogized to the hand 
5 signals used by baseball players and coaches to communicate 
during a baseball game (e.g., pulling on the ear, touching the 
nose, etc.). The signals or messages are visible to all, yet 
are difficult, if not impossible, to interpret because they are 
known only to the team using them, and because their meanings 

10 are often changed. Certain signals may have different meanings 
in different situations, which may confuse the other team or 
cause the other team to mistakenly believe a particular signal 
has another meaning. 

The selector may be used in a number of manners to 

15 disguise confidential information. For example, a selector may 
be used to select one of a plurality of messages to transmit 
to convey a particular piece of confidential information. 
Moreover, one or more of the messages may have a plurality of 
alternate meanings. This may permit one set of messages to 

20 represent a plurality of pieces of confidential information, 
although it should be appreciated that messages need not have 
more than one meaning. 

For example, Table I below shows a transform table 
illustrating how three messages J>At>, £>B£> and £Cfc> from a message 

25 set may be used by an agent to convey three pieces of 
confidential information (here, whether to accept or 
counteroffer) depending upon the value of a selector: 



Information to Convey 


Selector 


1 


2 


3 


will go lower, no risk 


Msg A 


Msg B 


Msg C 


may go lower, some risk 


Msg B 


Msg C 


Msg A 


doubtful will go lower, high risk 


Msg C 


Msg A 


Msg B 



Table I: Example Transform Table 
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One advantage of this configuration is that the messages, 
beyond disguising their contents or intended meaning, may cause 
another party to mistakenly believe a particular message has 
a different meaning. For example, if a buying agent sends a 
message to the client seeking authorization to complete a 
transaction at the last offered price, but the message is 
interpreted by the selling party to mean that the agent wants 
to terminate negotiations, the selling party may reduce its 
price to try to complete the transaction. 

A selector may also be used to select which of a 
plurality of messages contains the desired confidential 
information. For example, messages A, B and C from Table I 
above could all be transmitted together, within a single 
transmission, with the selector indicating which of the 
messages should be considered. Similarly, a selector may be 
used to select which of a plurality of messages to omit from 
a transmission. For example, for a set of messages A-C, 
transmit messages A and B but not C to convey a certain piece 
of information, 

A selector may be a predetermined parameter known to 
both the agent and client. For example, the selector may be 
modified after a predetermined number of communications or 
cycles (e.g., every three transmissions). 

A selector may also be transmitted between the agent 
and client in the same message as the confidential information, 
in a separate message within the same transmission, or in a 
separate transmission altogether. For example, an agent 
manager may transmit an ^increment selector!? message to the 
agent so that the next selector value in a set of possible 
values is used, or an agent may precede a message with a 
separate message indicating from which message set the manager 
should interpret the message (e.g., for Table I, message D 
indicates selector 1, message E indicates selector 2, message 
F indicates selector 3) . 

Multiple selectors may be interleaved with the 
confidential information in a message, e.g., sets of bits. For 
example, a 32 bit message could contain 3 8 -bit pieces of data, 
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along with 8 -bits of selector information parsed into 4 2 -bit 
selectors that are disposed at the boundaries of the 8 -bit 
pieces of data. A look-up table may be utilized to assist in 
the interleaving of selector information into a message. In 
addition, other extraneous information that is ignored during 
interpretation may be included in a message, e.g., a few high 
order bits may be added to a value, but may be ignored during 
interpretation. Furthermore, information may be split between 
multiple messages or transmissions, with a selector controlling 
from where the information may be retrieved and how it is to 
be interpreted. 

Moreover, the selector may be maintained as a 
distinct parameter that is known by or transmitted between the 
parties, or may be derived from an existing parameter having 
another use or purpose. For example, a selector may be derived 
from the time stamp on a message (e.g., the last digit, or the 
remainder when the sum of the digits is divided by three, 
etc.), or from a checksum value for the message. Other 
seemingly innocuous information, whether known to both the 
client and agent, or transmitted therebetween, may be used to 
generate a £>pseudo-random£> selector. 

Agent 160 of Fig. 1 illustrates a procedural process 
of decision making and message disguising, whereby a series of 
steps are executed sequentially by a computer program to handle 
the functions in blocks 164 and 166. However, procedural logic 
may be subject to reverse compilation and scanning by third 
parties. One alternative to agent 160 is illustrated in Fig. 
2, where an agent 170 substitutes a neural network 172 for 
procedural decision making. Message disguising is still 
handled through a procedural block 176 which receives a 
selector 177 and outputs a disguised message sent via block 
178. 

The implementation and training of neural networks 
is well known in the art. The primary advantage of neural 
network -implemented decision making is that it is extremely 
difficult to determine the logic trained into a neural network 
since the logic is based upon weights, and not on a procedural 
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process. A neural network utilizes a set of processing 
elements or nodes that are interconnected in a network, with 
each node typically outputting a weighted sum of its inputs. 
The weight to apply to each input to a node is fc>leamed£> over 
5 time by a neural network by training the network with sample, 
or training, data. 

However, while agent 170 is significantly more 
resistant to scrutiny by third parties, the agent may still be 
subject to some scrutiny since a procedural process is used in 

10 block 176 to generate disguised messages from an undisguised 
output generated by the neural network. It must be assumed 
that any undisguised data stored in an agent may be subject to 
reverse compilation and scanning when the agefit is in an 
unsecured environment. 

15 Fig. 3 illustrates an agent 180 which extends the use 

of a neural network to both decision making and message 
disguising. A neural network 182 receives a plurality of 
inputs, including also one or more selectors (e.g., selectors 
184 and 186) from which a disguised message is generated. 

20 Also, neural network 182 only outputs one or more disguised 
outputs (e.g., disguised output 1 and disguised output 2). 
Consequently, at no point is any undisguised data stored in 
agent 180. 

Training of neural network 182 requires additional 
25 training records or examples to handle message disguising in 
view of the additional input of a selector to the network. For 
example, to train a neural network without disguised messages, 
the standard training data would include N training records, 
as shown in Table II below: 

30 Inputs Outputs 

il. 1 il.2 il.3 ... ol 
i2.1 i2.2 i2.3 ... o2 

iN.l iN.2 iN.3 ... oN 

3 5 Table II: Standard Training Records 
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However, to also train the neural network to disguise 
messages, additional training records are required given that 
an output may be represented by more than one message. In 
general one group of training records are required for each 
5 possible value of the selector, which may be accomplished 
merely by reusing the original pure training information, 
duplicated for each value of the selector (e.g. , 1 - K) , and 
with the messages (e.g., messages A, B, ... M) properly 
arranged for each value, as shown in Table III below: 



10 


Inputs 




Selector 


Outputs 




ii.l 


il.2 


il.3 .. 


1 . 


msg 


l.A 




i2.1 


i2.2 


i2.3 .. 


1 


msg 


l.B 




iN. 1 


iN.2 


iN.3 .. 


i 


msg 


l.M 


15 


il.l 


il.2 


il.3 .. 


2 


msg 


2. A 




i2.1 


i2.2 


i2.3 .. 


2 


msg 


2 .B 




iN. 1 


iN.2 


iN.3 .. 


2 


msg 


2 .M 




il.l 


il.2 


il.3 .. 


3 


msg 


3 .A 


20 


i2.1 


i2.2 


i2.3 .. 


3 


msg 


3.B 




iN.l 


iN.2 


iN.3 .. 


3 


msg 


3 . M 




il.l 


il.2 


il.3 .. 


K 


msg 


K.A 


25 


i2.1 


i2.2 


i2.3 .. 


K 


msg 


K.B 




iN. 1 


iN.2 


iN.3 .. 


K 


msg 


K.M 



Table III : Example Training Records - One Selector 



To output more than one disguised message at a time 
30 requires no additional training besides that required by the 
number of inputs. For example, as shown in Table IV, to 
generate three output messages, the following training data may 
be used: 
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5 



Inputs 
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Selector 


Outputs 














il.l 


il . 


2 


3 . . 


1 


msg 


l.Al 


msg 


1 


A2 




i 

X 




i2 .1 


±2. 


2 


i2. 


3 . . 


1 


msg 


1.B1 


msg 


1 


.B2 


msg 


1 


.B3 


iN.l 


iN. 


2 


iN. 


3 . . 


1 


msg 


1.M1 


msg 


1 


.M2 


msg 


1 


.M3 


il • 1 


il . 


2 


il . 


3 . . 


2 


mo y 




msg 


2 


.A2 


msg 


2 


.A3 


i2.1 


i2. 


2 


i2 . 


3 . . 


2 


msg 


2.B1 


msg 


2 


. B2 


msg 


2 




iN.l 


iN. 


2 


iN. 


3 . . . 


2 


msg 


2 .Ml 


msg 


2 


.M2 


msg 


2 


.M3 


il.l 


il. 


2 


il. 


3. . . 


3 


msg 


3.A1 


msg 


3 


.A2 


msg 


3 


.A3 


i2.1 


i2. 


2 


i2. 


3 . . . 


3 


msg 


3.B1 


msg 


3 


.B2 


msg 


3 


.B3 


iN.l 


iN. 


2 


iN. 


3 . . 


3 


msg 


3. Ml 


msg 


3 


.M2 


msg 


3 


.M3 


il.l 


il. 


2 


il. 


3 . . 


K 


msg 


K.A1 


msg 


K 


. A2 


msg 


K 


.A3 


i2.1 


i2. 


2 


i2. 


3 . . 


K 


msg 


K.B1 


msg 


K 


.B2 


msg 


K 


.B3 


iN.l 


iN. 


2 


iN. 


3 . . 


K 


• 

msg 


K.M1 


msg 


K 


.M2 


msg 


K 


.M3 



Table IV: Example Training Records - Multiple Messages 

20 In addition, to generate disguised messages based 

upon more than one selector, a set of training data is required 
for each combination of selector values. For example, as shown 
in Table V, for a set of three selectors, and two outputs, the 
following training data may be used: 



25 


Inputs 








Selector 


Outputs 


















. il.l 


il. 


2 


il. 


3 . . 


. 1.1.1 


msg 


1.1. 


1 


.Al 


msg 


1. 


1. 


1 


.A2 




i2.1 


i2. 


2 


i2. 


3 . . 


. 1.1.1 


msg 


1.1. 


1 


-Bl 


msg 


1. 


1. 


1 


.B2 




iN.l 


iN. 


2 


iN. 


3 . . 


. 1.1.1 


msg 


1.1. 


1 


.Ml 


msg 


1. 


1. 


1 


.M2 


30 


il.l 


il. 


2 


il. 


3 . . 


. 1.1.2 


msg 


1.1. 


2 


.Al 


msg 


1 . 


1 . 


2 


.A2 




i2.1 


i2. 


2 


i2. 


3 . . 


. 1.1.2 


msg 


1.1. 


2 


.Bl 


msg 


1 . 


1. 


2 


.B2 




iN.l 


iN. 


2 


iN. 


3 . . 


. 1.1.2 


msg 


1.1. 


2 


.Ml 


msg 


1. 


1. 


2 


.M2 




il.l 


il. 


2 


il. 


3 . . 


. X.Y.I 


msg 


X.Y. 


1 


.Al 


msg 


X. 


Y. 


1 


.A2 


35 


i2.1 


i2. 


2 


i2. 


3 . . 


. X.Y.I 


msg 


X.Y. 


1 


.Bl 


msg 


X. 


Y. 


1 


.B2 




iN.l 


iN. 


2 


iN. 


3 . . 


X.Y.I 


msg 


X.Y. 


1 


.Ml 


msg 


X. 


Y. 


1 


.M2 




il.l 


il. 


2 


il. 


3 . . 


. X.Y.Z 


msg 


X.Y. 


Z 


.Al 


msg 


X. 


Y. 


Z 


.A2 


40 


i2 .1 


i2. 


2 


i2. 


3 . . 


. X.Y.Z 


msg 


X.Y. 


Z 


.Bl 


msg 


X. 


Y. 


Z 


.B2 




iN.l 


iN. 


2 


iN. 


3 . . 


. X.Y.Z 


msg 


X.Y. 


z 


-Ml 


msg 


X. 


Y. 


z 


• M2 



Table V: Example Training Records - Multiple Selectors 



It should be appreciated that the training records 
45 used to train a neural network depend upon the particular logic 
desired to be encoded in the network. Moreover, it should be 
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appreciated that the message disguising function of an agent 
may be implemented either via a neural network or with 
procedural decision making, and that separate neural networks 
may be used for the decision making and message disguising 
5 functions. In addition, various additional functions for an 
agent may be incorporated into the same or different neural 
networks as for either the decision making or message 
disguising functions. Other modifications will be apparent to 
one skilled in the art. 

10 Exemplary Hardware/Software Environment 

A representative hardware environment suitable for 
the training and/or hosting of intelligent agents consistent 
with the invention is illustrated in Fig. 4, where a networked 
computer system 10 generally includes one or more computer 

15 systems, e.g., single-user computer systems 16, 18 and multi- 
user computer systems 20, 60, coupled through a network 15. 
Multi-user computer system 20 typically includes one or more 
servers 25 to which one or more single-user computers 22 may 
networked through a separate network 24. Similarly, multi-user 

20 computer system 20 typically includes one or more servers 65 
coupled to one or more single -user computer systems 62 through 
a network 64. Network 15 may represent any type of networked 
interconnection, including but not limited to local -area, wide- 
area, wireless, and public networks (e.g., the Internet). 

25 It is anticipated that agents consistent with the 

invention may originate in and be resident from time to time 
on any of the above-mentioned computer systems. One possible 
distinction between the computer systems for the purposes of 
the invention may be whether each is a client or a remote 

30 system relative to a particular agent. For example, Fig. 5 
illustrates an embodiment of computer system 10 where multi- 
user computer system 20 is a client system, and multi-user 
computer system 60 is a remote system. 

A client system will hereinafter refer to a computer 

35 system that provides an agent a certain level of security from 
manipulation by other parties when the agent is resident on the 
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system. The client system is also the computer system from 
which management of the agent is typically handled. The agent 
typically but not necessarily will also originate from the 
client system. 

5 A remote system, on the other hand, will hereinafter 

refer to a computer system that is typically not capable of 
providing a desired level of security for an agent, generally 
because the computer system is not under the control of the 
client. It is typically while resident on a remote system that 

10 an agent runs the greatest risk of being scanned or reverse 
compiled, or of having communications intercepted or monitored, 
by other parties. 

The various embodiments described herein have 
principal uses in electronic commerce applications, where 

15 agents are configured to negotiate commercial transactions, 
generally in the role of buying or selling agents. The agents 
may negotiate with other agents, other computer systems, or 
even other individuals. The agents may interact one-on-one, 
or may be capable of operating within a fc>marketk> of multiple 

20 agents, along the lines of a stock or commodity market. 

Computer systems having the ability to host agents for 
interaction therebetween include negotiating programs of 
varying sophistication and are hereinafter referred to as agent 
hosts. However, it should be appreciated that the invention 

25 applies equally to other applications of intelligent agents, 
and thus should not be limited specifically to commercial 
applications . 

Fig. 5 illustrates a mobile intelligent agent 100 
which communicates with an agent manager 32 in client system 

30 20. During negotiation with another party such as negotiating 
agent 95, mobile agent 100 is resident on remote system 60. 
It should be appreciated that remote system 6 0 may be the 
client for agent 95, or may also be considered to be remote 
relative to this agent as well. 

35 An exemplary functional design of networked computer 

system 10 for implementing the various embodiments of the 
invention is illustrated in Fig. 6. Server 25 of client system 
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20 generally includes a central processing unit (CPU) 28 
coupled to a memory 30 and storage 40 over a bus 54. A local 
area network interface is provided at 52, and an interface to 
remote system 60 over external network 15 is "provided through 
5 interface 50. Agent manager program 32 is resident in memory 
30, as is an agent trainer program 34 which trains agents. 
Storage 40 includes one or more trained agents 42 (of which may 
include agent 100, for example), which are computer programs 
or modules that may be retrieved and used locally within system 

10 20, or dispatched to remote systems to execute and perform 
tasks on behalf of the client system. Storage 40 also includes 
an agent mission database 44 which may track agent operations 
and the relative success or failure thereof. -Moreover, a 
training database 46 includes training data utilized by agent 

15 trainer program 34 to train agents, and translation tables 48 
are utilized by agent trainer program 34 as well as by agent 
manager 32 to encode and decode messages to and from mobile 
agents, as will be discussed in greater detail below. 

Server 65 of remote system 60 also includes a CPU 68 

20 coupled to a memory 70, storage 80, external network connection 
90 and local network connection 92 over a bus 94. An agent 
host program 72 is resident in memory 70 to handle interactions 
between agents resident in the remote system. Typically, the 
agent host program is an asynchronous message/event driven 

25 environment that provides a common platform over which agent 
computer programs execute and interact, much like an operating 
system. The agent host is also capable of permitting messages 
to be sent between agents and their clients. Memory 70 also 
includes a negotiating program 74 which operates as the bother 

30 partyfc) in transactions with agent 100, which may be another 
agent, a market or bulletin board application, or even an 
interface program through which an individual interacts with 
agent 100. Storage 80 maintains a transaction history database 
82 which logs the transactions completed on the server. 

35 Servers 25, 65 may be, for example, AS/400 midrange 

computers from International Business Machines Corporation. 
However, it should be appreciated that the hardware embodiments 
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described herein are merely exemplary, and that a multitude of 
other hardware platforms and configurations may be used in the 
alternative. 

Moreover, while the invention has and hereinafter 
5 will be described in the context of fully functioning computer 
systems, those skilled in the art will appreciate that the 
various embodiments of the invention are capable of being 
distributed as a program product in a variety of forms, and 
that the invention applies equally regardless of the particular 
10 type of signal bearing media used to actually carry out the 
distribution. Examples of signal bearing media include but are 
not limited to recordable type media such as floppy disks, hard 
disk drives, and CD-ROM's, and transmission type media such as 
digital and analog communications links. 

15 Decision Making and Message Disguising with Intelligent Agents 

Fig. 7 illustrates an exemplary program flow 
illustrating the interaction between an agent 100, agent 
manager 32 and another party, negotiating agent 95. 
Negotiations are generally instituted by agent manager 32 by 

20 dispatching agent 100 to a remote system, as illustrated in 
block 130. It should be appreciated that agent 100 may be 
dispatched with a desired transaction or transactions which the 
client wishes to complete (including information such as 
desired quantity, description of goods/services to be 

25 sold/purchased, etc,) , as well as any other constraints placed 
upon the agent by the manager (e.g., the number of negotiation 
iterations to process, a maximum or minimum limit on the amount 
to offer, etc.). In the alternative, some or all of this 
information may be relayed to agent 100 at a later time by 

30 agent manager 32. 

Next, in block 132, agent 100 gathers and filters 
information after it has been dispatched to the remote system. 
For example, agent 100 may poll a bulletin board or market for 
outstanding offers, or may attempt to find and initiate 

35 negotiations with another party, e.g. , another computer system, 
another agent, or an individual interacting through a computer 
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system. Agent 100 may also simply wait for incoming offers 
from other parties. Block 132 also performs the functions of 
processing messages from other parties and from the agent 
manager. 

Next, in response to input received by agent 100, a 
decision is made by agent 100 in block 134. it is in this 
block that the negotiation strategy of agent 100 is 
implemented/ whereby the agent determines, based upon the input 
it receives, whether and how to proceed in negotiations with 
another party. Also, supportive procedural processing is 
completed, such as incrementing internal counts, e.g., the 
number of iterations (discussed below) . 

Generally, one of three actions may be instituted in 
response to block 134. First, as illustrated by block 136, 
agent 100 may decide to send a message to other party 95, e.g., 
indicating acceptance or rejection of an outstanding offer, 
issuing an offer or counteroffer, terminating negotiations, 
requesting that the other party wait, etc. The other party 
receives the message at block 138 and processes it at block 
140, typically issuing a response message back to agent 100. 
Control of agent 100 returns to block 132 to process the 
response message from party 95. 

Second, as illustrated by blocks 141 and 142, agent 
100 may decide to send a message back to agent manager 32. 
Consistent with the invention, this message is disguised in 
block 141 in the manner disclosed herein, and then sent in 
block 142. Agent manager 32 then receives and interprets the 
message at block 144, processes the message in block 14 6 and 
disguises and sends a response message back to agent 100 in 
block 148. Upon receipt of the response message, block 150 
interprets the message and passes control to block 132 to 
process the response message from agent manager 32. 

Third, as illustrated by block 152, agent 100 may 
decide to leave the remote system and return to its client 
system, e.g., after completion of a successful transaction or 
after termination of an unsuccessful negotiation. The return 
of the agent is illustrated in block 154. 
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The illustrated program flow for agent 100 is an 
example of a semi -autonomous agent that has authority to 
negotiate with another party with limits on the offer amount 
and the number of iterations (offers made by the agent) that 
5 the agent can undertake on its own. Agents with greater or 
lesser degrees of domain knowledge may also be used consistent 
with the invention. For example, a fully autonomous agent may 
be delegated the authority to negotiate without any input other 
than a desired transaction. In contrast, a fully dependent 

10 agent may have little authority other than to act as an 
intermediary by issuing offers and completing transactions 
pursuant to specific instructions from a manager and reporting 
the results back to the manager. 

Various agents of this type are discussed further, 

15 for example, in U.S. Patent Application Serial Nos. 08/826,107 
and 08/822,993, respectively entitled "APPARATUS AND METHOD FOR 
OPTIMIZING THE PERFORMANCE OF COMPUTER TASKS USING MULTIPLE 
INTELLIGENT AGENTS HAVING VARIED DEGREES OF DOMAIN KNOWLEDGE" 
and "APPARATUS AND METHOD FOR OPTIMIZING THE PERFORMANCE OF 

20 COMPUTER TASKS USING INTELLIGENT AGENT WITH MULTIPLE PROGRAM 

MODULES HAVING VARIED DEGREES OF DOMAIN KNOWLEDGE", which have 
been incorporated by reference. As is also discussed in these 
applications, agent 100 may be one of several agents having 
varying degrees of domain knowledge, or may have multiple 

25 modules with varying degrees of domain knowledge, so that the 
agent may be optimized for operation in different situations 
based upon an objective criteria (e.g., security concerns). 

The primary components in agent 100 for implementing 
the program flow of Fig. 7 are illustrated by negotiation 

30 module or mechanism 200 in Figs. 8a and 8b. A mechanism or 
module may be considered to include any function, object, or 
block of program code configured to perform a desired task or 
operation. 

Module 200 is configured to utilize a selector such 
35 as a message time stamp or other transmitted parameter, with 
a single set of messages used to disguise various confidential 
instructions and requests passed between the client and the 
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agent. The client and agent in this embodiment transmit only 
one message at a time to represent a given instruction or 
request, and some if not all of the messages have alternate 
meanings depending upon the value of the selector. However, 
5 it should be appreciated that any of the above -described 
modifications and variations in terms of possible selectors and 
manners of disguising messages may be used in the alternative. 

Module 200 is configured to receive the following 

inputs : 

10 - other party's last price 

other party's current price 
agent's last public offer 
product characteristics 
instruction from manager: 
15 increase in offer authorized 

increase in iterations authorized 
increase in offer not authorized 
increase in iterations not authorized 
last message sent back to manager 
20 - selector (s) 

In addition, module 200 is configured to generate the 
following outputs: 

public price offer 
message to other party 
25 make offer 

withdraw 
accept 
reject 

counteroffer 
30 - - please wait 

finished 
message to manager 

probable acceptable alternative, do you 
accept 

35 - - iterations exceeded, recommend continue 
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iterations exceeded, recommend 
withdrawal 

recommend immediate withdrawal 
dummy transmission to motivate 
5 negotiation 

request approval to increase offer 

Two variables, the number of iterations and the offer 
increment (the current authorized negotiation margin for the 
agent) , are also maintained in module 200 for feedback 
purposes, but are generally not accessed by external sources. 

Moreover, for training purposes, additional 
information may also be used in the generation of suitable 
training records, although the information is not directly 
input to the module. Such information includes: 
desired price and features 

agent autonomy price range (range of prices 
within which agent is authorized to negotiate 
au tonomou s ly ) 

manager approval price range (range of prices 
within which agent requires approval from 
manager) 

acceptable iterations allowed without approval 

Module 200 includes a primary neural network 202 in 
which the decision logic for decision making (including 
25 negotiation strategy) , message disguising, and other functions 
is implemented. In addition, as shown in Fig. 8a, a number of 
filters 204-214 are utilized at the input side of primary 
network 202 to condition the inputs to the network, since 
neural networks typically operate on weights in the range of - 
30 1 to +1, or 0 to +1. Filters 204-214 may be implemented using 
procedural logic, or alternatively, may be implemented using 
separate neural networks to increase security. 

A selector decode filter 204 is implemented in this 
embodiment as a neural network which receives the desired 
35 selector information and outputs a decoded selector signal, 
designated sel. The decoded selector signal is provided to 
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primary network 202 , as well as to a number of the filters in 
module 200, as detailed below. The configuration of filter 204 
will vary depending upon the type of information used as a 
selector. For example, if a time stamp or other transmitted 
5 parameter is used, such information would be input to filter 
204 ♦ On the other hand, if a non- transmitted parameter is 
used, e.g., if the selector is changed every n transmissions, 
then filter 204 may be configured as a logic element such as 
a counter which is incremented every n transmission cycles. 

10 Because it may be possible for selector values to be observed 
as they are being gathered, any amount of superfluous 
information may also be gathered to assist in deception. 

The last and current prices offered by the other 
party to the negotiation are stored in a pair of registers 220, 

15 222 and conditioned by filters 206 and 208, which in this 
embodiment are implemented using neural networks. In addition, 
the last offer generated by the agent is stored in a register 
224 and conditioned by filter 210, also implemented as a neural 
network. Filters 206-208 also receive the decoded selector 

20 input. Registers 220 and 222 are maintained by the information 
gathering block 132 (Fig. 7) based upon the prices received 
from the other party. Register 224 is maintained by a price 
offer generator filter 228 (Fig. 8b, as discussed below) . 

In addition, each filter 206-210 outputs an 

25 identification (ID) signal, as well as three data signals 
designated value 1, value 2 and value 3. The ID signal output 
by each filter operates similar to a selector to indicate which 
of the n (here three) data signals includes the conditioned 
representation of the corresponding register's contents. The 

30 other two data signals operate are unused and act as decoys to 
deter reverse compilation of the decision logic of the module. 
The ID signal may be a function of the decoded selector input, 
or may be independent thereof. In the alternative, a single 
value signal may be connected between each filter 206-210 and 

35 primary network 202 if detection of these conditioned signals 
is not a concern. 
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An instruction decode network filter 212 receives 
binary messages from the client, as well as the decoded 
selector signal to interpret the messages. A single 
instruction signal is output from filter 212. The instruction 
5 signal varies for any given message depending upon the value 
of the decoded selector signal. 

An optional basic requirements network filter 214, which 
is primarily useful for a buying agent, receives one or more 
product characteristics related to the features of the 

10 goods/services being negotiated for compared to the features 
desired by the client. In response, filter 214 outputs a match 
signal which indicates the degree in which the products being 
negotiated for match what the client is actually 'looking for. 

The product characteristics may include basic 

15 requirements that must be met to complete the transaction, as 
well as additional features that may not be required but which 
may make the products more desirable to the client. For 
example, for a VCR, a client may require that it have four 
heads, but the client may be willing to pay more for a hi-fi 

20 stereo model if one is available. The match signal for a hi-fi 
model being negotiated for may be weighted more strongly than 
one without hi-fi, and as a consequence, the agent may be 
configured to negotiate more strongly for the hi-fi model in 
response to this signal. 

25 Two additional registers 216, 218 are maintained by 

primary network 202 and are fed back as input thereto. An 
offer increment register 216 represents the current negotiation 
margin for the agent, as modified by the agent manager through 
instructions to the agent. The negotiation margin represents 

30 in filtered form that amount over which (for a buying agent) 
or under which (for a selling agent) the agent may complete a 
transaction outside of the desired price for the transaction. 

An iteration register 218 maintains in filtered form 
the number of cycles in the current negotiation, where one 

35 cycle typically represents a transmission from the agent to 
another party or to the agent manager. The agent is typically 
trained with a number of cycles for which the agent is 
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authorized to negotiate without approval from the manager, and 
this number may be varied or overridden in response to an 
instruction from the agent manager. 

Primary network 202 also receives as feedback a price 
offer delta signal related to the change in the agent's last 
and current offers, and a send message signal and a undisguised 
message signal related to the last message sent from the agent 
to the client. Each of these signals are output from network 
202 (Fig. 8b) . 

As shown in Fig. 8b, primary network 202 outputs a 
number of other signals in response to the inputs shown in Fig. 
8a. A set of filters 226-234 condition these output signals 
from neural network levels to levels that are * more useful 
external to the primary network. 

A negotiation message creator filter 226, which is 
implemented in this embodiment as procedural logic, receives 
an output signal from network 202 and any value from the price 
offer generator 228 and outputs a message to the other party. 
The output message may include a number of possible messages, 
such as accept, reject, counteroffer, wait request, and 
negotiations finished, among others. The format of the message 
may follow a predetermined protocol that is understandable to 
the other party. 

A price offer generator filter 228, which is also 
implemented in procedural logic in this embodiment, receives 
a price offer delta parameter and the value previously stored 
in my last offer block 224 and outputs therefrom the current 
price offer which is stored in register 224. The price offer 
delta parameter is also fed back to primary network 202 as 
described above. 

The current offer may be supplied in conjunction with 
the message to the other party provided by filter 226. In 
addition, the current offer may also operate as a public offer 
which can be polled by other agents wishing to engage in 
negotiations with agent 100. The current offer may also be 
output to a market or bulletin board set up on an agent host 
to solicit negotiations with other parties. 



WO 98/47250 



PCT/US98/04876 



An adjust iteration filter 230, which in this 
embodiment is implemented with procedural logic, receives an 
iteration increment signal to increment register 218 in 
response thereto. Filter 230 also receives a reset signal to 
5 reset register 218 in response to an increase in iterations 
authorized instruction. 

In addition, an increment processor filter 232, 
implemented in this embodiment with procedural logic, receives 
a change increment signal and an increment value signal. In 

10 response to a suitable change increment signal, the increment 
value represented by the increment value signal is output in 
filtered form and stored in register 216. 

A message creator filter 234, which is- implemented 
as procedural logic in this embodiment, is used to output 

15 disguised messages to the agent's client in the manner 
discussed above. Filter 234 receives a send message signal as 
well as a signal for the disguised message to send. As 
discussed above, the undisguised message is typically one of 
several messages such as: "probable acceptable alternative, do 

20 you accept", "iterations exceeded, recommend continue", 
"iterations exceeded, recommend withdrawal", "recommend 
immediate withdrawal", a dummy transmission to motivate 
negotiation, and "request approval to increase offer", among 
others. The send message signal initiates the transmission of 

25 a disguised message for the given message output by primary 
network 202. 

The decoded selector signal sel is also received as 
input to block 234 as well as unf iltered selector values for 
inclusion in the message as needed. Other value signals, such 

30 as the current and/or last prices offered by the other party 
and stored in registers 220, 222, and the product 
characteristics supplied to filter 214, may also be received 
as input for incorporation in the message to the manager. 

In response to these inputs, filter 234 outputs a 

35 message to the agent manager. The message may be text, binary 
or other data formats which are recognizable by the agent 
manager. For example, the message may be a textual message 
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representative of one of the undisguised messages, but with the 
selector indicating another message than that represented by 
the undisguised message (e.g., with a certain selector, 
"recommend immediate withdrawal" may be interpreted by the 
5 agent manager to mean "probable acceptable alternative, do you 
accept" ) . 

It should be appreciated that in the illustrated 
embodiment of module 200, the decision making and message 
disguising functions of agent 100, which may be conceptually 

10 considered to be performed by separate decision making and 
message disguising modules or mechanisms (e.g., as illustrated 
by blocks 134 and 141 in Fig. 7) , are both principally 
implemented in primary network 202. It should also be 
appreciated that the functions may be separated into different 

15 neural networks in the alternative. Moreover, it should be 
appreciated that primary network 202 may also be implemented 
via an interconnected network of separate neural networks. 

As a component of its decision making function, 
primary network 202 may implement a number of negotiation 

20 strategies consistent with the invention. For example, U.S. 

Patent Application Serial No. 08/821,935, entitled "INTELLIGENT 
AGENT WITH NEGOTIATION CAPABILITY AND METHOD OF NEGOTIATION 
THEREWITH", which has been incorporated by reference, discloses 
a negotiation strategy which relies on the previous and current 

25 offers from the agent as well as the previous and current 
prices offered by the other party. A number of additional 
negotiation features suitable for use by primary network 202 
are also implemented in the aforementioned application, 
including dynamic value determination, disguising negotiation 

30 strategy by randomizing an agent's behavior, and limiting 
unproductive negotiations by constraining an agent's behavior, 
among others. Other negotiation strategies and features may 
also be used consistent with the invention. 

A wide variety of known neural network designs may 

35 be used for primary neural network 202 and any of the 
illustrated network filters consistent with the invention. For 
example, one suitable neural network design is a back 
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propagation neural network known in the art . Other neural 
network designs, including a radial basis function network, 
among others, may also be used in the alternative. A suitable 
development environment for performing the development and 
5 training of such neural networks is the IBM Neural Network 
Utility available from International Business Machines 
Corporation, among others. 

Training for the networks in module 200 is performed 
via the Supervised training process for neural networks, with 

10 the exception of the additional input provided by the decoded 
selector signal. Each neural network/filter in module 200 may 
be trained separately, although the v training process is 
significantly simplified if the entire module 200 is trained 
at once using combined training records. 

15 For example, one suitable process for training module 

200 is illustrated by network training routine 300 in Fig. 9. 
Generally, the program flow includes three nested for-next 
loops. The first for-next loop, illustrated at block 302, 
cycles through each possible value of the selector (s). For 

20 each value, a second for-next loop, illustrated at block 302, 
cycles through each training record. 

For each training record, the record is obtained in 
block 306. A suitable training record may have the general 
format illustrated in Table II above. 

25 Next, a third for-next loop, illustrated at block 

308, cycles through each output in the record, and at block 
310, generates a trained output value using a transform 
function that is based upon the current value of the selector, 
and the desired output. The trained output is retrieved using 

30 a transform table, e.g., as illustrated by Table I above, where 
a disguised message is selected from a set of messages to 
represent a desired output. 

Once suitable disguised (trained) outputs have been 
generated for a training record, block 3 08 passes control to 

35 block 312 to train the neural network using the training 
record, current selector and the disguised outputs. After the 
training record is used to train module 200, control then 



-28- 



WO 98/47250 



PCT/US98/04876 



returns to block 304 to process the next training record. 
Program flow continues until module 200 has been trained with 
each training record, as modified for each value of the 
selector (s) . 

5 It should be appreciated that a primary benefit of 

routine 300 is that training is simplified since the need to 
generate separate training records for each selector value is 
eliminated. In the alternative, however, individual training 
records for each value of the selector may be generated, e.g., 

10 in the forms illustrated in Tables III-V above. 

It is anticipated that module 200 of agent 100 may 
be trained by an agent manager to handle all possible 
situations, including all of the types of goods/sexvices , etc. 
to be purchased or sold by the agent, whereby the agent manager 

15 merely dispatches the agent when negotiations are desired. In 
the alternative, the agent manager may train an agent with only 
the information related to a particular desired transaction 
immediately prior to dispatching the agent. This latter 
process may require additional time to dispatch an agent once 

20 a transaction is desired, however, the size and complexity of 
the agent may be significantly reduced if the agent is more 
narrowly focused. 

It should be appreciated that beyond decision making 
and disguising messages, other functionality may be required 

25 for the autonomous operation of agent 100, and that such 
additional functionality may be implemented via procedural 
logic and/or neural networks, whether incorporated within 
negotiation module 200 or in a separate program module. For 
example, functions such as initialization, maintenance, finding 

30 other agents or markets to interact with, etc. may also be 
utilized. However, as these functions relate more to the basic 
operation of an agent, which is in general known in the art, 
these functions will not be discussed in any greater detail 
herein. 

35 Other modifications will be apparent to one skilled 

in the art. Therefore, the invention lies solely in the claims 
hereinafter appended. 
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Claims 



1 1. A method of communicating between an intelligent 

2 agent computer program and a client computer process, 

3 comprising the steps of: 

4 (a) selecting a message from a plurality of messages 

5 based upon a selector and information to be transmitted 

6 between the intelligent agent and the client computer 

7 process; and 

8 (b) transmitting the selected message between the 

9 intelligent agent and the client computer process. 

1 2. The method of claim 1, wherein the selecting and 

2 transmitting steps are performed in the intelligent agent, and 

3 wherein the method further comprises the step of determining 

4 the information to be transmitted using a neural network into 

5 which has been programmed a decision logic for the intelligent 

6 agent. 

1 3. The method of claim 2, wherein the selecting step 

2 includes the step of selecting the message using a neural 

3 network into which has been programmed a transform table for 

4 matching a message with the information to be transmitted. 

1 4. The method of claim 3, wherein the intelligent agent 

2 is configured to conduct negotiations in an electronic commerce 

3 application, wherein the decision logic for the intelligent 

4 agent includes a negotiation strategy, and wherein the 

5 information to be transmitted by the intelligent agent includes 

6 at least one of the group consisting of probable acceptable 

7 alternative do you accept, iterations exceeded recommend 

8 continue, iterations exceeded recommend withdrawal, recommend 

9 immediate withdrawal, request approval to increase offer, and 
10 a dummy transmission to motivate negotiation. 
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1 5. The method of claim 1, wherein the selector includes 

2 a predetermined parameter known to both of the intelligent 

3 agent and the client computer process. 

1 6. The method of claim 5, wherein the selector is 

2 changed after a predetermined number of transmissions between 

3 the intelligent agent and the client computer process. 

1 7. The method of claim 1 # wherein the selector is 

2 transmitted between the intelligent agent and the client 

3 computer process. 

1 8. The method of claim 1, wherein the -selector is 

2 derived from an existing parameter having another purpose. 

1 9. The method of claim 8, wherein the selector is 

2 derived from a time stamp appended to the selected message 

3 transmitted between the intelligent agent and the client 

4 computer process. 

1 10. The method of claim 1, wherein each of the plurality 

2 of messages has a plurality of alternate meanings which are 

3 selected based upon the selector. 

1 11. The method of claim 1, wherein the selecting step 

2 includes the step of selecting at least one additional message 

3 from the plurality of messages, and wherein the transmitting 

4 step includes the step of additionally transmitting the 

5 additional message between the intelligent agent and the client 

6 computer process; whereby the selector controls which of the 

7 transmitted messages includes the information to be 

8 transmitted. 

1 12 . The method of claim 1 , wherein the selecting step 

2 includes the step of selecting each message from the plurality 

3 of messages with the exception of an omitted message 

4 corresponding to the information to be transmitted, and wherein 
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5 the transmitting step includes the step of transmitting every 

6 message in the plurality of messages except for the omitted 

7 message, 

1 13. The method of claim l f wherein the selecting step 

2 includes the step of determining the message to select using 

3 a transform table indexed by the selector and the information 

4 to be transmitted. 

1 14. The method of claim 1, wherein the message 

2 transmitted in the transmitting step is unscrambled. 

1 15. A method of communicating with an intelligent agent 

2 computer program, the method comprising the steps of: 

3 (a) processing with a neural network an input 

4 received from an external source and thereby generating 

5 an output therefrom; 

6 (b) disguising the output in an output message 

7 selected from a plurality of messages based upon the 

8 output and a selector; and 

9 (c) transmitting the output message. 

1 16. The method of claim 15, wherein the disguising step 

2 is performed using a neural network. 

1 17. The method of claim 16, wherein the processing and 

2 disguising steps are performed using the same neural network. 

1 18. A method of communicating between an intelligent 

2 agent computer program and a client computer process, 

3 comprising the steps of: 

4 (a) receiving a disguised message transmitted 

5 between the intelligent agent and the client computer 

6 process, the disguised message selected from a plurality 

7 of messages, each of which is related to predetermined 

8 information based upon a selector; 

9 (b) determining the selector; and 
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10 (c) interpreting the disguised message using the 

11 selector to determine the predetermined information 

12 transmitted in the disguised message. 

1 19 . A program product comprising: 

2 (a) a program configured to perform a method of 

3 communicating between an intelligent agent computer 

4 program and a client computer process, the method 

5 comprising the steps of : 

6 (1) selecting a message from a plurality of 

7 messages based upon a selector and information to be 

8 transmitted between the intelligent agent and the 

9 client computer process; and 

10 (2) transmitting the selected message between 

11 the intelligent agent and the client computer 

12 process; and 

13 (b) a signal bearing media bearing the program. 

1 20. The program product of claim 19, wherein the signal 

2 bearing media is transmission type media. 

1 21. The program product of claim 19, wherein the signal 

2 bearing media is recordable media. 

1 22. An apparatus for communicating with one of an 

2 intelligent agent computer program and a client computer 

3 process, the apparatus comprising: 

4 (a) a decision logic mechanism, configured to 

5 receive an input from an external source and generate 

6 therefrom an output; and 

7 (b) a message disguising mechanism, configured to 

8 receive the output of the decision logic mechanism and 

9 output one of a plurality of messages as a disguised 

10 message in response to a selector and the output of the 

11 decision logic mechanism. 
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1 23. The apparatus of claim 22, wherein the decision logic 

2 mechanism is incorporated in an intelligent agent computer 

3 program, and wherein the decision logic mechanism includes a 

4 neural network into which has been programmed a decision logic 

5 for the intelligent agent. 

1 24. The apparatus of claim 23, wherein the message 

2 disguising mechanism includes a neural network into which has 

3 been programmed a transform table for matching a message with 

4 the information to be transmitted* 

1 25. The apparatus of claim 24, wherein the decision logic 

2 mechanism and the message disguising mechanism are incorporated 

3 into the same neural network. 

1 26. The apparatus of claim 23, wherein the decision logic 

2 mechanism further comprises a plurality of neural network 

3 filters for conditioning inputs and outputs to and from the 

4 neural network. 

1 27. The apparatus of claim 23, wherein the intelligent 

2 agent is configured to conduct negotiations in an electronic 

3 commerce application, and wherein the neural network is 

4 programmed with a negotiation strategy for the intelligent 

5 agent. 

1 28. The apparatus of claim 22, wherein the selector 

2 includes a predetermined parameter known to both of the 

3 intelligent agent and the client computer process. 

1 29. The apparatus of claim 22, wherein the selector is 

2 transmitted between the intelligent agent and the client 

3 computer process. 

1 30. The apparatus of claim 22, wherein the selector is 

2 derived from an existing parameter having another purpose. 
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